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Guaranteed Cost LQG Control of Uncertain Linear 
Quantum Stochastic Systems 
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Abstract 



Q^ ' In this paper, we formulate and solve a guaranteed cost control problem for a class of uncertain 

linear stochastic quantum systems. For these quantum systems, a connection with an associated classical 

(~| . (non-quantum) system is first established. Using this connection, the desired guaranteed cost results are 

I '■ estabhshed. The theory presented is illustrated using an example from quantum optics. 
-)— > ■ 

§h; I. INTRODUCTION 

The feedback control of quantum systems is an important emerging research area; e.g., see 

Q^ ■ [1], [2], [5]-[7], [10], [13], [16]-[19]. However, most of the existing results in quantum feedback 

\^ ! control do not directly address the issue of robustness with respect to parameter uncertainties 

• [ in the quantum system model. In this paper, we study guaranteed cost control for a class of 

O 
OO 

o 



uncertain linear quantum systems. We consider quantum systems described by linear Heisenberg 
dynamics driven by quantum Gaussian noise processes, and controlled by a classical linear 
feedback controller. This class of systems includes examples from quantum optics with classical 
controllers implemented by standard analog or digital electronics. For such quantum systems, we 
address the issue of robust controller design by allowing for norm bounded uncertainties in the 
matrices defining the quantum model. Also, we consider the case of uncertainties in a quadratic 
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Hamiltonian defining tlie quantum dynamics. Such uncertainties can represent uncertainty in the 
values of the physical parameters of the quantum system. Our results can also be extended to 
allow for linear unmodeled quantum dynamics subject to a certain iJ°° norm bound constraint. 

Guaranteed cost control involves constructing a controller such that the expected value of a 
quadratic cost functional satisfies a given bound for all possible values of the uncertain parameters 
in the model. The quadratic cost functional is determined to reflect the performance requirements 
of the quantum control system. This means that a controller can be constructed which addresses 
not only the issue of robustness but also the issue of performance. 

A classical controller for a quantum systems takes measurement data obtained by monitoring 
the quantum system continuously in time. The controller determines the control actions which 
influence the dynamics of the quantum system in a feedback loop. The results in this paper 
provide a method for designing such classical controllers to achieve a guaranteed bound on a 
quadratic cost functional when the quantum system model is subject to uncertainty. Our results 
exploit simple computations of quantum expectations in Gaussian states which provide a link to 
an auxiliary classical system. This enables us to use established classical guaranteed cost control 
results to obtain corresponding quantum guaranteed cost control results. 

The paper is organized as follows. Section |II] sets up a basic framework for describing the 
class of uncertain linear quantum systems under consideration. A quantum linear system is then 
related to an auxiliary classical (non-quantum) system. In Section Ulll we present a guaranteed 
cost result for the auxiliary classical uncertain system and then use this to establish our main 
result which is a guaranteed cost result for the linear quantum uncertain system. An example 
from quantum optics is given in Section |IV] to illustrate our main results. Some conclusions are 
given in Section |Vl 
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II. PROBLEM FORMULATION AND PRELIMINARY RESULTS 

A. Uncertain Linear Quantum System 

We consider an uncertain linear quantum system described by the following non-commutative 
stochastic differential equations: 

dx = {[A + BoACo]x + [Bi + BoADo]u) dt + Bq dv; x(0) = xq, 
fx = Cix + D12U, 

dy = [C2 + D2oACo]x dt + [D22 + D2oADo]udt + D20 dv; y{0) = 0. (1) 

Here v{t) vector of self- adjoint quantum noises with Ito table: 

dv{t)dv'^{t) = Fydt, (2) 

where F^ is a non-negative Hermitian matrix which satisfies i(F„ + Fj) = J; e.g., see [3], 
[14]. Note that it is straightforward to extend the results of this paper to allow for more general 
matrices F„; e.g., see [11]. The noise processes can be represented as operators on an appropriate 
Fock space; e.g., see [3], [14]. Also x{t) is vector of possibly non-commutative self-adjoint 
system variables which are operators defined on an appropriate Hilbert space. The components 
of x{t) represent physical properties of the system at time t (using the Heisenberg picture), 
such as position and momentum. The quantity /i(t) is also a vector of possibly non-commutative 
self-adjoint variables corresponding to physical observables defining the desired performance 
objective. The classical quantities u{t) and y{t) represent control inputs and measurement outputs, 
respectively. Their components are self adjoint and commute among themselves and at different 
times. The matrices A, Bq, Bi, Cq, Ci, C2, Dq, D12, D22, -D20 are known constant real matrices 
of appropriate order and A is an uncertain norm bounded real matrix satisfying 

A^A < /. (3) 

We also consider an associated quadratic cost functional 

J(n(-))= f ' {fi^{t)^,{t)) dt. (4) 



where the notation (■) represents expectation over all initial variables and noises. The interval 
[0, tf] is the fixed time horizon. It is assumed that the initial condition a:o is Gaussian, with 
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density operator p. We let Xq := {xq) and 

1 



Yn 



((xo -xo)(a;o -^o) + ((a;o - ^o)(a;o - ^o) ) )• 



The system model © includes a wide range of quantum, classical, and quantum-classical 
stochastic uncertain systems. 

Together with the uncertain quantum system ([T]), consider a classical (non-quantum) controller: 



dxK = AkXk dt + Bk dy; xk{0) = xko, u = CkXr- 



(5) 



Here the controller initial state xkq is a fixed real vector. For a given value of the uncertainty 
matrix A satisfying Q, the quantum system ^ and the classical controller Q together produce 
a closed loop classical-quantum system: 



where 
A 

C 



dr] = At] dt + B dv; //(O) = tjq, 
H = Cr], 

A + BoACo [B^ + BoADo]Ck 

Bk [C2 + D20AC0] Ak + Bk [D22 + D2oAD^]Ck 



(6) 



B 



Bo 

BkD20 



Ci D12CK 



V 



X 
Xk 



(7) 



The guaranteed cost control problem under consideration involves constructing a classical output 
feedback controller of the form ^ and a cost bound M > 0, such that cost dH) corresponding 
to the closed loop system ^ satisfies the bound J(m(-)) < M for all uncertainty matrices A 
satisfying ©. 

For a given value of the uncertainty matrix A satisfying dB]), we now define the following 
matrix valued function of time associated with the closed loop system ^: 



P{t):=-{r,{t)rf{t) + {r^{tW{t)r). 



(8) 



Note that Pq := P(0) = diag(lo) 0). Using this definition, we can establish the following lemmas 
which provide a link between the cost associated with the classical-quantum closed loop system 
^ and the cost associated with an auxiliary linear classical (non-quantum) closed loop system. 
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Lemma 1: The value of the cost (U) corresponding to the closed loop system © is given by 

J(u{-)) = [ ^ Tr{C^CPit)) dt. (9) 

Jo 
Proof. We have 

Hence, upon integration, it follows that the corresponding closed loop cost is given by (|9l). D 
Lemma 2: The matrix valued function P(-) defined by ([8]) satisfies the differential equation 

P = AP + PA^ + BB^- P(0) = Po, (10) 

where Pq = diag(Fo7 0). 

Proof. Using the quantum Ito rule (e.g., see Chapter HI of [14]), it follows from the definition 

of P(-) in dS]), that 

dP = ]^[{d7]rj^) + {{dr]rfY) + {i^dif) + {{r]dTff) + {BF,B^ + (BF^B^f) dt] 

= [AP + PA^ + -B{F, + Pj)P'"] dt. 

Therefore, P(-) satisfies the differential equation (flOl) . D 

5. Auxiliary Classical Uncertain System 

We now define the auxiliary classical uncertain system which will be used to solve the quantum 
guaranteed cost control problem defined above: 

dx = {[A + BoACo]x + [Pi + BoADo]u) dt + Bq dv; x(0) = xq, 
/x = Cix + Duu, 
dy = [C2 + D2oACo]x dt + [P22 + D2oADo]udt + P20 dv; y{0) = 0. (1 1) 

Here, x{t) is a real vector of state variables, u{t) is the control input vector, y{t) is the measured 
output vector, w{t) is a classical Wiener process, and xq is a Gaussian random variable with mean 
xq and covariance matrix Yq. Also, A is an uncertain norm bounded real matrix satisfying (|3]). 
The matrices defining the classical uncertain system (fTTI) are the same as the matrices defining 
the quantum uncertain system ([T]). Associated with this classical uncertain system is the quadratic 
cost functional J{u{-)) := /J^ E[n'^ (t) nit)] dt. 
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For a given value of the uncertainty matrix A satisfying ^, the classical system (fTTI) and the 
classical controller ^ together produce a closed loop classical system: 

d( = AC dt + B dv] ?7(0) = ?7o, 

^i = CC, (12) 

X 

where ( := is a real vector of state variables for the closed loop system and the matrices 

Xk 

A, B, and C are defined as in (|7]). 

Lemma 3: For a given uncertainty matrix A satisfying ([3]), the value of the cost J(u{-)) 
corresponding to the quantum classical closed loop system Q is the same as value of the cost 
J{u{-)) corresponding to the classical closed loop system (fT2)) . 

Proof. Let Q{t) := E({t)('^{t). Clearly Q{0) = Pq. As in Lemma [H one can now show 
that j(n(-)) = Jq^ Tr [C'^CQit)) dt. Also, in a similar fashion to the proof of Lemma [21 (but 
using the classical Ito rule instead of the quantum Ito rule), it follows that Q{-) also satisfies 
the differential equation ^^. Thus Q{-) = P(-), and hence J(m(-)) = -Jiui-))- □ 

From this lemma, we immediately obtain the following result. 

Lemma 4: Suppose a classical controller of the form ([5]) is a guaranteed cost controller for 
the classical uncertain system (fTT)) such that the closed loop system (fT2)) satisfies J(m(-)) < M 
for all uncertain matrices A satisfying ([3]). Then this classical controller is also a guaranteed cost 
controller for the quantum uncertain system ([T]) such that the closed loop system Q satisfies 
Jiu{-)) < M for all uncertain matrices A satisfying (|3]). 

IIL THE MAIN RESULT 

It follows from the results of the previous section that we can find a guaranteed cost controller 
for the quantum uncertain system ([T]) by constructing a guaranteed cost controller for the classical 
uncertain system (fTT)) . This leads to the main result of this paper which is Theorem [2] given in 
Subsection IIII-BI However, to obtain this result, we first consider the classical case. 

A. Guaranteed Cost Control of the Classical Uncertain System 

In order to construct a suitable guaranteed cost controller for the classical system (fTTI) . we 
will use a result which is derived from the minimax LQG results of [15]. In order to present 
this result, we first require some assumptions and notation. 
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Assumption 1: For simplicity, we assume Ci = 
simplification, the expression for the cost becomes 






, and Di2 = 




^1/2 



J{u{-))= I [x^Rx + u^Gu] dt. 
'o 



With this 



(13) 



Also, we assume there exists a do > such that T = D20D2Q > dol. 
Notation. For r > 0, we define the matrices 

Rr = R + tC^Co, Gr = G + tD^Do, Tr = tG^Dq. 

Assumption 2: There exists a r > such that the following three conditions hold: 

1) The Riccati differential equation 

Y = {A- BoDj,T-'G2)Y + Y{A- BoDlT~'G2f -Y{GjT-'G2--Rr)Y 

T 

+Bo{I-DlT-'D2o)Bl (14) 

has a symmetric solution Y{-) : [0,t/] -^ r^^x" satisfying Y{0) = Yq and, there exists a 
Co > 0, such that Y{t) > cqI, for all < t < t/. 

2) The Riccati differential equation 

-X = X{A-BiG;'T^) + iA-BiG;^T^fX + R^-T^G;^T^ 

-I-dT 



-X{B2G^ B2 -DO-Dq 

r 



BnBn )X, 



(15) 



0. 



has a symmetric nonnegative definite solution X{-) : [0,t/] — > R"^" with X{tf) 
3) For every < t < tj, the spectral radius of the matrix Y{t)X{t) is less than r. 
Theorem 1: Suppose that the classical uncertain system (fTTI) is such that Assumptions [T] and 
|2] are satisfied. Then the controller ([5]) defined by the matrices 

Ak 
Bk 



A + -YRr - BkG2 + (5i + -YTr)GK - BKD22GK, 
T T 



{YG^ + B,Dl,)V~\ Gk = -G;\B^X + T^)(/ - -YX)-\ 

T 

and the initial condition xko = Xq, is a guaranteed cost controller for the classical uncertain 
system (fTT)) . and the associated closed loop value of the cost satisfies the bound J(n(-)) < Vt 
for all uncertainty matrices A satisfying Q where 



2Vr = x^X{0)iI--YoX{0))-'xo 



T 



+ / Tr 

Jo 



YRr + Bk{YGJ + BoD^o)fX{I - -YXy' 

T 



dt. 



(16) 
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Proof. First note the classical uncertain system (fTTI) . can be re-written in the form 

dx = {Ax + Biu + -BqO '^^ + ^0 dw, 
/i = Cix + D12U, 

Z = CqX + DqU, 

dy = {C2X + D22U + D20O dt + D20 dw, (17) 

where ^ = Az. Also, ||^|| = ||A2;|| < ||2;||. This yields the Stochastic Integral Quadratic 

Constraint: 

E TuitWdtKE r\\z{t)rdt. (18) 

Jo Jo 

It now follows that the uncertainty in the classical uncertain system (fTTI) is a special case of the 
uncertainty in the minimax optimal control result Theorem 8.4.1 of [15]. From this result the 
required guaranteed cost control result follows. D 

B. Guaranteed Cost Control of the Quantum Uncertain System 

Combining Theorem [T] and Lemma HI we immediately obtain the following result which is 
the main result of the paper. 

Theorem 2: Suppose that the quantum uncertain system ([T]) is such that Assumptions [T] and 
I2I are satisfied. Then the controller ^ defined by the matrices 

Ak = A + -YRr-BKC2 + {Bi + -YTr)CK-BKD22CK, 

T T 

Bk = {YC^ + B,Dl)T-\ Ck = -G;\B^X + Tl){I --YX)-\ 

T 

and the initial condition xko = ^o^ is a guaranteed cost controller for the quantum uncertain 
system (fTT)) . and the associated closed loop value of the cost satisfies the bound J{u{-)) < K 
for all uncertainty matrices A satisfying Q where 

2K = x'^X{0){I--YoX{0))-'xo 

T 



dt. (19) 



+ /' Tr \YRr + Bk{YCJ + BoD^^,)fX{I - -YX)-' 
io L r J 

Remarks. It is possible to extend Theorem [1] to the case in which the norm bounded uncertain 
matrix A in the classical uncertain system (fTT)) is replaced by a stable H"^ norm bounded 
transfer function matrix A(s); e.g., see Section 2.4.3 of [15]. This enables Theorem |2| to be 
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extended to allow for linear unmodeled dynamics in the quantum system ([T]). In this case, 
the linear unmodeled quantum dynamics would be defined by quantum stochastic differential 
equations corresponding to matrices obtained from a state space realization of the uncertain 
transfer function A(s). 

Note that if the quantum system ([T]) has no uncertainty, Cq = 0, Dq = 0, and we let r ^ oo, 
then Theorem |2] reduces to a result on quantum LQG control; e.g., see [7], [8]. 



C. Application to Quantum Uncertain Systems with Uncertainty in the Hamiltonian Matrix 

Rather than describing a linear quantum system in terms of a quantum stochastic differential 
equation such as in ([T]), a quantum system can also be described in terms of a quadratic 
Hamiltonian H = x{0)^ Rox{0) and a coupling operator L = Ax(0); e.g., see [8], [11]. Here Rq 
is an n X n real matrix and A is an A^^, x n complex matrix. Then as in [8], [11], the dynamics 
of the quantum system can be described as follows: 



Xk{t) 

yiit) 

dU 



k = l,2, 



1 = 1,2, 



; '^yy 



uityxkio)u{t), 
u{trwi{t)u{t), 

(-iHdt- -L^L dt + [-L\ L^]r dw) U, f/(0) = /. 

where the variables Xk are the system variables, the variables yi are the output variables and U{t) 
is an adapted process of unitary operators. Then as in [1 1], the nominal matrices A, Bq, Bi, C2, -D20 
in ([T]) are given by 



A 



Bq Bi 



2z0[-AU^ir 



Co 



p\ 



Ny 



D20 ^UyXriu 



where A^^ = ^, AT, = ^,S 



p; 



Ny 



'Ny 



'Ny 



'Ny 



'Ny 



A + A# 



P, 



Ny, 



^nyX{nyj-ny) 



Ny 



iNyXNy ONyXiNy,-Ny) 



,e = ^(a:(0)a;(0)^-(a;(0)x(0) 



T\T 



Pn is the Uy x Uy permutation matrix satisfying 



Ny 



ai a2 



fli as 



o-uy-i ^2 a^ 
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1 I 
1 -I 



and A* is obtained by taking the adjoint of each of the 



P7v„.diag^^^2 
components of A. 

We now consider the case in which the matrix defining the Hamiltonian is subject to uncertainty 
with a specific structure and show that this leads to an uncertain linear quantum system of the 
form ([T]). Suppose that the quadratic Hamiltonian is of the form H = x{0)^Rx{0) where 



R = Ro + t[-A^A^]ToACo, A 



On. 



A 



(20) 



and A is a real (ra^ —nu — riy) x n uncertain matrix satisfying AA"^ < /. Here Cq is an arbitrary 
(but fixed) n X n matrix, and Fq is the matrix consisting of the first n^ — Uu columns of F. In 
this case, it is straightforward to verify that this leads to a linear quantum uncertain system of 
the form ^ where the matrices A, Bq, Bi, Co, C2, -D20 are defined as above. 

IV. ILLUSTRATIVE EXAMPLE 

In this section, we consider an example which illustrates the use of Theorem [21 We consider 
an optical cavity resonantly coupled to three optical channels as shown in Figure [H e.g., see [9] 
and [11]. 




Fig. 1. An optical cavity (plant). 
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The annihilation operator a for this cavity system (representing a standing wave) evolves in 
time according to the equations 



da 
dY 



■—a dt — y/KidW — y/K2dV — y/l^dU, 
^a dt + dW. 



(21) 



Here 7 = /ti + K2 + K3. The system (|2T1) can be written in real quadrature form as follows (e.g., 
see [11]): 

dw 



dx = Ax dt + Biu dt + Bq 



dv 



dy = C2X dt + D 



20 



dw 
dv 



(22) 



Here a = {xi+iX2)/2, y = yi = Y + Y*, V = (t;i + zt'2)/2, W = {wi + iW2)/2, U = {ui + iU2)/2, 



du = udt 



Ui 
U2 

7 



dt, dv 



dvi 

dV2 



dw 



dwi 

dW2 



A = --/, B, 



nil 2 \fi^I: 



Bi = -v/^J, C2 



kT 



D 



20 



10 



The quantum noises v,w have Hermitian Ito matrices defined as follows: 

dv{t)dv'^{t) = F^dt, dw{t)dw'^{t) = F^dt, F^ = F^ = 



1 i 
-i 1 



Now suppose an uncertain parameter 6 is introduced into the linear quantum system (l22l) 
corresponding to a perturbation in the parameter K2. Then linear quantum system (|22l) becomes: 



dx = {A I)x dt + Biu dt + Bo{6) 



dw 
dv 



dy = C2X dt + D 



20 



dw 
dv 



(23) 
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where Bq(5) 



Hill \/i%2 + 51 



. We assume that the absolute value of the uncertain 



parameter 6 is bounded as \6\ < 6o where 6o < 2-^/1 + k,2- Now let 



2 







\/k2+S() ^ 



, Co = I, Do = 



and observe that Bo{6o)ACo = -fj, D20AC0 = 0, Bo{6o)ADo = 0, D20AD0 = 0, and 
A^A < /. From this, it follows that the above model for the cavity is a special case of the 
following linear quantum uncertain system 

dx = {[A + Bo{6o)ACo]x + [Si + Bo{So)ADo]u) dt + Bq{5) 



dw 
dv 



dy 



{[C2 + ^2oACo]x + D^^AD^u) dt + D 



20 



dw 
dv 



(24) 



where A^A < /. Furthermore, in order to convert this into a quantum uncertain system of the 
form O note that Bq{6)Bq{6)'^ < Bo{6o)Bq{6o)^ for all 6 such that \6\ < 60. Hence, we can 
increase the size of the noise in this uncertain system to obtain the following quantum uncertain 
system of the form ([T]): 

dw 



dx = {[A + Bo{So)ACo]x + [Bi + Bo{5o)ADo]u) dt + Bo{So) 



dv 



dy 



{[C2 + D2oACo]x + D20AD0U) dt + D 



20 



dw 
dv 



(25) 



Thus, if we can construct a controller which leads to a guaranteed cost upper bound on the cost 
functional 



■JH-)) 



T, 



{x Rx + u Gu) dt 



(26) 



for this quantum uncertain system, then this controller will lead to the same upper bound on the 
closed loop value of the cost functional (|26|) when applied to the model of our cavity. 

We now apply Theorem [21 to the quantum uncertain system (|25|) and cost functional (|26l) . 
taking ki = K2 = n^, = 2, R = G = I, tf = 100, and 60 = 1. For the long time horizon being 
considered, the solutions to the Riccati differential equations (fT4l) . (fT5l) can be approximated by 
the solutions to the corresponding algebraic Riccati equations. Solving these Riccati equations 
for different values of the parameter r > 0, we find that the cost bound K defined in (fT9l) is 
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minimized with r = 1.41. For this value of r, we obtain the cost bound of V^ = 322.1. The 
corresponding Riccati solutions are 



X 



0.455 
0.455 

Also, the corresponding controller matrices are 



Y 



1.267 
1.361 



A 



K 



-2.908 

-2.297 



B 



K 



0.377 




C 



K 



1.088 
1.148 



This classical controller can be implemented using standard electronic devices. The closed loop 
quantum-classical system is illustrated in Figure |2l 




controller 



Fig. 2. An optical cavity (plant) controlled by a classical system (controller K, implemented using standard 
electronics). The quadrature measurement is achieved by homodyne photo-detection (HD), and the control actions 
are applied via an optical modulator (Mod). 



We now consider a modification to the above example to provide an example of a quantum 
system with uncertainty in the Hamiltonian matrix such as considered in subsection IIII-C[ This 



July 29, 2008 



DRAFT 



14 



example consists of a cavity with uncertainty in the detuning parameter. The cavity detuning 
corresponds to a mismatch Vl between the resonant frequency of the optical cavity and the 
frequency of input field. In this case, equation (|2T)) describing the cavity is modified by replacing 



-7 



the term -^ by the term 

case except the matrix A is now given by A 



2 , iQ. Thus, the coefficient matrices are the same as in the previous 

"" -? -n 



Q 



This system can be considered as an open quantum harmonic oscillator with noise input 

[w V u]^, Hamiltonian matrix R = ^I and coupling matrix A = ,/k^ \f^i ■ In this 

example, we consider an uncertainty in the frequency mismatch Vt. Incfeed, a perturbation in Vt 
io Vt = VLq + Vie with \VlJ\ < e^ corresponds to a perturbation R = Rq + E m the Hamiltonian 
matrix where Rq = ^f^/ and E = ^^I. Furthermore, this perturbation is of the form (l20l) with 




A 



CO 



Qe 






and Co 
The corresponding guaranteed cost controller was calculated in the case when f2o = and 



eo = 1 keeping all other system parameters the same as in the previous example. In this case, a 
parameter value of r = 0.9 gave the minimal closed loop cost bound Vr = 126 and the associated 
controller matrices are 



A 



K 



-2.067 

-2.336 



B 



K 



0.202 




.C, 



K 



0.519 
0.521 



This controller could also be implemented as in Figure |2l 



V. CONCLUSIONS 

In this paper, we presented a theory for synthesizing classical guaranteed cost controllers for 
a class of uncertain linear quantum stochastic systems. The theory was illustrated using some 
simple examples from quantum optics. 
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